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AMONG DATA COMMUNICATIONS PORTS IN 
AUTOMATED SECURITIES TRADING SYSTEMS 
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MICHAEL BUNDY 
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SPECIFICATION 

BACKGROUND 

Broker-dealer systems for automated trading of securities need to be fast. Broker-dealer 
systems receive orders from customers, send the orders to markets, receive responses 
from markets, and communicate order status to customers. Orders are sent to markets 
through data communications ports. Responses are received from markets through data 
communications ports. Ports are dedicated to particular markets. Data communications 
ports have limitations upon the number of orders that can be sent through them in a 
particular period of time or the nxmiber of orders without acknowledgments that can be 
sent through them. If more orders arrive than can be sent through a port in a particular 
period of time, the broker-dealer system is slowed. If a port partially fails or is slowed 
for mechanical or electrical reasons, the broker-dealer system is slowed. If a port fails 
completely, the broker-dealer system is disabled with regard to the market served by that 
port. 
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Broker-dealers often add additional ports to their systems, so that more than one port is 
dedicated to a particular market. Adding ports improves overall throughput of orders to 
markets and reduces the risk of being completely disabled with respect to a market if a 
port fails. System performance can still vary widely, however, from the point of view of 

5 a customer whose order is sent through a port that is slowed or stopped by overload or 
mechanical failure. Such a customer experiences the harmful effect of a lack of balance 
in the communications load among the ports for the market to which the customer's order 
was intended. Methods and systems are needed for balancing the communications loads 
among ports for markets in support of the overall quality of data communications in 

1 0 broker-dealer systems . 



SUMMARY 

15 A first aspect of the invention provides methods of balancing data conmiunications loads 
among data communications ports in systems for automated trading of securities. The 
systems for trading securities include at least one broker-dealer system coupled through 
at least one data communications system to more than one market system. Data 
communications systems include ports organized so that one market is coupled to the 

20 broker-dealer system through more than one port. Embodiments of the invention include 
methods of load balancing applied when a new order from the broker-dealer system is 
available and ready to be sent through a port to a market. The inventive methods in 
typical embodiments are apphed continually in tum to each port assigned to a market. 

25 Embodiments of load balancing methods typically include the steps of receiving 

acknowledgments of orders previously sent through a port from a broker-dealer system to 
a market, sending acknowledgments to the broker-dealer system, and determining that 
port are not overloaded. Various embodiments of the present invention make 
determinations of overload on the basis of latency, net order count, or order count 
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compared with acknowledgment count. 

Alternative embodiments of the invention send orders only through least-loaded ports. 
Least-loaded ports are identified on the basis of latency, net order count, or a combination 
5 of the two. 

A second aspect of the invention provides a load balancing system for automated trading 
of securities in which data communications loads are balanced among data 
communications ports. Embodiments of a load balancing system are typically coupled to 
10 a multiplicity of ports organized so that one market is coupled to a broker-dealer system 
through more than one port. Embodiments of a load balancing system typically function 
when a new order from a broker-dealer system is available and ready to be sent through a 
port to a market. Embodiments of a load balancing system are typically operative 
continually in turn upon each of the ports assigned to a market. 

15 

Embodiments of the load balancing system typically comprise at least one computer 
processor coupled for data communications to at least one broker-dealer system and 
coupled through data communications ports to more than one market. In typical 
embodiments, the processor is programmed to receive through a port from a market to 
20 which the port is coupled a new acknowledgment of an order previously sent through the 
port from the broker-dealer system to the market. The processor in typical embodiments 
is programmed to send the new acknowledgment to the broker-dealer system. 

The processor in typical embodiments of this second aspect of the invention is 
25 programmed also to determine that the port is not overloaded, with overload being 
determined according to measures of latency, net order count, or order count and 
acknowledgment count. The processor in most embodiments is programmed also to send 
a new order through the port to the market. Many embodiments of the load balancing 
system include computer memory coupled to the processor with the processor 
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programmed also to store in computer memory the new acknowledgment and the new 
order. 

In many embodiments of the invention, the processor is programmed also to send orders 
5 to markets only through least-loaded ports. Processors are typically programmed to 
determine that a port is least loaded dependent upon latency, net order count, or a 
combination of latency and net order count. 

10 DRAWINGS 

Figure 1 is an overview of a first aspect of the invention, a method of load balancing. 
Figure 2 is a detailed data flow view of various embodiments of the invention. 
Figure 3 illustrates a determination of no overload by determining that latency is less than 
the maximum allowed. 

15 Figure 4 illustrates a determination of no overload by determining that a net order count 
is less than a maximum net order count. 
Figure 5 is an example port data structure. 

Figure 6 illustrates a determination of no overload by determining that an order count 
exceeds an acknowledgment count by less than a maximiun net order count. 
20 Figure 7 illustrates altemative embodiments effecting load balancing by use of least- 
loaded ports. 

Figure 8 is an overview of a second aspect of the invention, a load balancing system. 
Figure 9 is a detailed structure view of various embodiments of the invention. 
Figure 10 illustrates a processor programmed for a determination of no overload by 
25 determining that latency is less than the maximum allowed. 

Figure 1 1 illustrates a processor programmed for a determination of no overload by 

determining that a net order count is less than a maximum net order count. 
Figure 12 illustrates a processor programmed for a determination of no overload by 

determining that an order count exceeds an acknowledgment count by less than a 
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maximum net order count. 
Figure 13 illustrates alternative embodiments with a processor programmed to effect load 
balancing by use of least-loaded ports. 

5 DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 

Definitions: 

"Acknowledgment" is a response from a market in which an order has been placed, the 
10 response being a confirmation that an order has been received by the market. 

"Coupled/' except when context requires otherwise, means coupled for data 
communications. This is particularly the case when describing broker-dealer systems as 
being coupled to markets through data communications ports. Broker-dealer systems 
15 typically are coupled to ports, which ports in turn typically are coupled to markets. 

Methods of coupling for data communications useful with the invention include all forms 
of data communications networks, intranets, extranets, intemets, local area networks, 
wide area networks, dedicated lines, satellite links, and the like. Any functional method 
of data communications is well within the scope of the invention. 

20 

"ECN" abbreviates "Electronic Communications Network," referring to an order 
matching service that provides liquidity by matching orders rather than by maintaining 
inventory. In the context of the invention, ECNs are considered markets. ECNs, like 
market makers are identified by use of market participant identification codes or 
25 "MPIDs." In order to avoid confusion with data communications networks, ECNs are 
referred to as either "ECNs" or as "markets." Some current ECNs, their symbols and 
names, are listed below. The number and identities of ECNs changes firom time to time. 
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Example List ofECNs 


MPID 


Name 


ARCA 


Archipelago 


BTRD 


Bloomberg Trade Book 


INCA 


Instinet 


ISLD 


Island 


MWSE 


Midwest Stock Exchange 


NTRD 


NexTrade 


REDI 


Speer Leeds 



"Exchange" means a national, regional, or international exchange for securities trading 
including for example, Nasdaq or NYSE. 

5 "Execution," is a kinds of response to an order from a market, the execution indicating 
that the order has been at least partly filled, that is, that shares have been either bought or 
sold according to the side of the order, 

"Filled" means executed. That is, all shares in the order have been executed, bought or 
10 sold according to the side of the order. If an order is subject to partial ftilfiUment, then 
the order can be partly filled and partly rejected or cancelled, in which case the order will 
never be considered filled. Processing of an order can therefore be completed through 
some combination of cancellation, rejection, killing, and partial execution without the 
order's ever being filled. Processing of an order is said to be complete when all the 
15 shares in the order, share by share, have been executed, cancelled, rejected, or killed. 
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"Latency means a measure of the speed with which markets respond to orders and 
cancellations. Latency in many embodiments of the invention is determined as the 
difference between the time when a response to an order is received and the time when 

5 the corresponding order was routed to the market. Latency can be measured from normal 
orders or from test orders. Some markets support test orders as such. For markets in 
which test orders as such are not supported, test orders can be implemented by use of 
unmarketable orders immediately followed by cancellations. For markets receiving 
orders regularly, latency can be tracked from normal orders, without the need for test 

10 orders. Latency can be embodied as a single ratio difference between two recorded times 
or as various kinds of averages. One type of average latency usefiil with the invention is 
a moving average latency, a latency in which the average is dependent upon a number of 
recorded times for orders and acknowledgments, the times being recorded during a 
defined period of time, such as, for example, one trading day. Another type of average 

15 latency usefixl with the invention is a decaying average latency, in which the average is 
dependent upon a set number N of recorded times for orders and acknowledgments, the 
set number defining the N most recently recorded times. Other kinds of average latencies 
can be used, all of them being well within the scope of the invention. 

20 "Level Two Quotes" are quotes that comprise one or more market participant quotes 
("MPQs"). The best known source of level two quotes is Nasdaq, but "level two quotes" 
refers to any form of market information that aggregates market participant quotes for a 
security. 

25 "Market," "electronic market," "market participant," "electronic market participant," 
"marketing network," "electronic communications network," "ECN," "exchanges," and 
"electronic marketing network" are all used as synonyms for services accessible through 
electronic conmiunications networks capable of executing orders for securities by 
accepting from broker-dealers buy orders and sell orders, matching or failing to match 
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buy orders with sell orders, and communicating the results to the broker-dealers. 
Generally the term "market" is used to refer to these entities. 

"Market maker" means a broker-dealer providing order matching and liquidity in a stock 
by maintaining an inventory of the stock. Market makers typically trade their inventories 
through exchanges. Some currently active market makers, their symbols and names, are 
listed below. The number and identity of market makers can change from time to time. 

Example List of Market Makers 



MPID Name 



BEST 


Bear, Steams & Co., Inc. 


BTAB 


Alex, Brown & Sons, Inc. 


GSCO 


Goldman, Sachs & Co. 


HMQT 


Hambrecht & Quist, LLC 


HRZG 


Herzog, Heine, Geduld, Inc. 


JANY 


Janney Montgomery Scott, Inc. 


LEHM 


Lehman Brothers, Inc. 


MADF 


Bernard L. Madoff 




Merrill Lynch, Pierce, Fenner & 


MLCO 




Smith Inc. 


MOKE 


Morgan, Keehan & Co., Inc. 




Nationsbanc Montgomery Securities, 


MONT 




LLC 


MSCO 


Morgan Stanley & Co., Inc. 
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NITE 



PRUS 



PIPR 



OLDE 



OPCO 



Knight Securities, L.P. 
Olde Discount Corporation 
CIBC Oppenheimer Corporation 
Piper Jaffray Inc. 
Prudential Securities, Inc. 



RAJA 



PWJC 



Paine Webber, Inc. 

Raymond James & Associates, Inc. 



SBSH 



SHRP 



Smith Barney, Inc. 
Sharpe Capital, Inc. 



SHWD 



Sherwood Securities Corporation 



"Orders" are orders for purchase or sale of securities. In the embodiments described, 
"orders" are electronic orders for purchase or sale of securities. 

5 "Quotes" are aggregates of information regarding securities traded in markets. Quotes 
include for securities hsted for sale or purchase, symbols identifying the securities, price, 
side, quantities, and market identifications or MPIDs. Quotes can come from exchanges 
or directly from markets. A "Nasdaq Level Two Quote" includes market information in 
the form of market participant quotes for all markets offering to buy or sell a particular 

1 0 security through Nasdaq. 

"Securities" are any agreement for investment. Stocks are the securities most often 
addressed in described embodiments of the invention. The invention, however, is 
applicable to many kinds of securities including, for example, options, commodities, and 
15 bonds. 

"Side" refers to which side of the market is represented by an order or a quote. Side 
indicates whether the quote or order is to buy or sell, bid or ask. "Bid" indicates the buy 
side. "Ask" indicates the sell side. The present invention fimctions equally for either 
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side of a transaction. Therefore we attempt to speak in neutral terms regarding side. We 
speak of execution rather than buying or seUing. We use the term "price improvement" 
to indicate both price reductions for buy orders and price increases for sell orders. 

5 

Detailed Description: 

Figure 1 shows an overview of a first aspect of the invention, a method (102) of load 
balancing data communications ports in systems for automated trading of securities. 

10 hi the first illustrated embodiment, the systems include at least one broker-dealer system 
(106) coupled for data communications (140) through at least one data communications 
system (104) to more than one market (130-134). The illustrated embodiment of the data 
communications system is coupled to a multiplicity of data communications ports (1 10- 
126) organized so that one market (130) is coupled to the broker-dealer system through 

15 more than one port (1 10,1 12). The method (102) is apphed when a new order (108) from 
the broker-dealer system (106) is available and ready to be sent through a port to a 
market, hi typical embodiments, the method is applied continually in turn to each of the 
ports assigned to a market. 

20 Figure 2 is a more specific illustration of certain embodiments of the invention. One 
embodiment shown in Figure 2 includes receiving (202) through a port (218) from a 
market (222) to which the port is coupled (252) a new acknowledgment (204) of an order 
(230) previously sent through the port from the broker-dealer system to the market. This 
embodiment includes sending (206) the new acknowledgment (204) to the broker-dealer 

25 system (1 06) where the new acknowledgment is stored in computer memory (226) with 
other acknowledgment (224). The illustrated embodiment includes determining (208) 
that the port is not overloaded, the determination being dependent upon the previously- 
sent order (230), the new acknowledgment (204), and optionally also dependent upon 
other previous orders (228) and upon previous acknowledgments (224). The illustrated 
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embodiment also includes sending (210) a new order (212) through the port to the 
market. Sending (210) the new order is dependent upon the determination (208) that the 
port is not overloaded. That is, in this embodiment, new orders are sent to markets only 
through ports that are not overloaded. 

5 

Li a further embodiment shown in Figure 3, determining (208) that the port is not 
overloaded further comprises determining (326) that a latency (320, 322) for the port is 
less than a maximum allowed latency (324) for the port. Latency comprises a measure of 
the speed with which markets return acknowledgments for orders. 

10 

As shown in Figure 3, in one embodiment, the latency for the port is an instant latency 
(320). In an alternative embodiment, the latency for the port is an average latency (322). 
In embodiments using latencies as shown in Figure 3, the port latencies are dependent 
upon orders (310) and acknowledgments (312) in that the latencies comprise various 
15 kinds of comparisons between order times (3 14), the times when particular order were 
sent to a market, and acknowledgment times (316), the times when acknowledgments 
corresponding to particular orders were received back from markets. 

More specifically, an instant latency (320) is the difference between the time when a 
20 recent acknowledgment was received and the time when the acknowledgment's 

corresponding order was sent. In addition, as shown in Figure 5, an average latency in 
some embodiments is a decaying average (524) and in other embodiments is a moving 
average (522). Examples of methods and systems useful with the present invention for 
calculating latencies are set forth in Appendix L The use of any method of calculating 
25 latency is well within the present invention. 

A further embodiment shown in Figure 4 includes decrementing (402) a net order count 
(504) for the port (218), wherein the net order count (504) indicates the net number of 
orders sent through the port to the market for which acknowledgments have not yet been 
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received from the market. The net order count (504) for the port (218) is stored in 
computer memory in a port data structure (502). 

An example of a port data structure useful in many embodiments of the invention is 
5 shown in Figure 5. The term "port data structure" means a data structure for storing data 
descriptive of the port. It does not mean that the port data structure is part of the port. 
On the contrary, in most embodiment, port data structures are stored in computer memory 
in a communications system in which a method of load balancing method is implemented 
according to the present invention. 

10 

The further embodiment illustrated in Figure 4 includes determining (404) that the net 
order count (504) is less than a maximum allowed net order coxmt (506) for the port. The 
maximum net order count (506) indicates the maximum number of orders without 
acknowledgments allowed to be sent through the port (218). The fact that the net order 
15 count (504) is less than the maximum net order count (506) for the port (218) indicates 
that the port (218) is not overloaded. 

This further embodiment shown in Figure 4 includes incrementing (406) the net order 
count. Alternative embodiments increment (406) the net order count (504) after 
20 determining (404) that the net order count (504) is less than the maximum net order count 
(506) for the port but before (408) sending (210) a new order (212) to market (222). 
Other embodiments increment (406) the net order count (504) after determining (404) 
that the net order count (504) is less than the maximum net order count (506) for the port 
(218) and also after (410) sending (210) a new order (212) to market (222). 

25 

A further embodiment shown in Figure 6 includes incrementing (602) an 
acknowledgment count (510) for the port (218). The acknowledgment count (510) 
represents the number of acknowledgments received through the port (218) during a 
defined period of time. An example of a period of time useful with various embodiments 
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of the invention is one trading day. Other embodiments use other time periods, some 
shorter, some longer. Any functional time period is within the scope of the invention. 

A further embodiment shown in Figure 6 includes determining (604) that an order count 
5 (508) for the port (218) exceeds the acknowledgment count (5 10) for the port (218) by at 
least a maximum net order count (506). The order count (508) represents the number of 
orders sent through the port (218) during the defined period of time. The maximum net 
order count (506) indicates the maximum number of orders for which acknowledgments 
have not been received allowed to be sent through the port. The fact that the order count 
10 (508) for the port (218) exceeds the acknowledgment count (510) by at least the value of 
the maximum net order count (506) indicates that the port (218) is not overloaded. 

This illustrated embodiment of Figure 6 includes incrementing (606) the order count for 
the port. Alternative embodiments increment (606) the order count (508) after 

15 determining (604) that the order count (508) for the port (218) exceeds the 

acknowledgment count (510) by at least the value of the maximum net order count (506) 
but before (608) sending (210) a new order (212) to market (222). Other embodiments 
increment (606) the order count (508) after determining (604) that the order count (508) 
for the port (218) exceeds the acknowledgment count (510) by at least the value of the 

20 maximum net order count (506) and also after (610) sending (210) a new order (212) to 
market (222). 

A further embodiment of the invention as shown in Figure 7 includes determining (740), 
before sending (206) the new order (212) through the port (216) to the market (222), that 
25 the port is a least-loaded port. Li this kind of embodiment, sending (206) the new order 
(212) through the port to the market is dependent (750) upon determining that the port is 
a least-loaded port (740). 

More specifically, in this kind of embodiment, shown in Figure 7, utilizing detection of 
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least-loaded ports for load balancing, new orders typically are sent only through ports 
determined to be least-loaded. "Least-loaded" means generally that according to some 
measure of data communications load, the load of the subject port is at least as low as any 
other port. That is, although there may be other ports for the market having the same 
5 load as the subject port, there is no port with a lower load. Measures of data 

communications load useful with the invention include, for example, measure of latency 
and net order count. 

In a specific embodiment shown in Figure 7, determining that the port is a least-loaded 
10 port (740) further comprises determining (742) that the net order count (710) for the port 
(216) is not greater than any of the net order counts (720, 730) for the other ports (218, 
220) coupled to the market (222). hi this illustrated embodiment, determining (742) that 
the net order count (710) for the port (216) is not greater than any of the net order counts 
(720, 730) for the other ports (218, 220) coupled to the market (222) is the indication that 
15 the port (216) is a least-loaded port. As shown in Figure 7, the embodiment provides data 
structures (702, 704, 706) for computer memory in which are stored the net order counts 
(710, 720, 730), one data structure (702, 704, 706) corresponding (703, 705, 707) to each 
port (216, 218, 220), The net order counts (710, 720, 730) indicate the net number of 
orders sent through the ports (216, 218, 220) to the market (222) for which 
20 acknowledgments have not yet been received from the market. 

An alternative embodiment shown also in Figure 7 determines (740) the port (216) to be 
least-loaded by determining (744) that a latency (712) for the port is not greater than any 
of the latencies (722, 732) for the other ports (218, 220) coupled to the same market 
25 (222). In this illustrated embodiment, the latencies (712, 722, 732) are stored in port data 
structures (702, 704, 706), one data structure for each port. Latency comprises a measure 
of the speed with which markets return acknowledgments for orders. 

Each port, in the illustrated embodiment of Figure 7, is characterized by a measured or 
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calculated latency( 712, 722, 732). The latencies in various embodiments are instant 
latencies, moving average latencies, decaying average latencies, or other forms of 
latency. Most forms of measurement or calculation of the speed or time delay required to 
send orders to a market through a port and receive in return corresponding 
5 acknowledgments are functional latencies within the scope of the present invention. 

A further alternative embodiment shown in Figure 7 determines (740) that the port is a 
least-loaded port by determining (746) that the product of the net order count (710) for 
the port (216) multiplied by the latency (712) for the port (216) is not greater than the 
10 product of net order count (720, 730) and latency (722, 732) for any other port (218, 220) 
coupled to the market (222). In this illustrated embodiment, the latencies (712, 722, 732) 
and the net order counts (710, 720, 730) are stored in port data structures (702, 704, 706), 
one data structure for each port. 

15 Turning to Figure 8, an overview of a further aspect of the invention is seen. Figure 8 
shows a load balancing system (802) for automated trading of securities in which data 
communications loads are balanced among data communications ports (816-832). The 
load balancing system (802) in one embodiment illustrated in Figure 8 is coupled to a 
multiplicity of ports (816-832) organized so that one market is coupled to the broker- 

20 dealer system through more than one port, the markets identified in Figure 8 by reference 
numbers 834-838. hi the embodiment illustrated, the load balancing system (832) is 
programmed to operate when a new order (814) from a broker-dealer system (810) is 
available and ready to be sent through a port (816-832) to a market (834-838). The load 
balancing system of the kind illustrated in Figure 8 is programmed to operate continually 

25 in turn upon each of the ports assigned to a market. 

Tuming now to Figure 9, more specific embodiments of a load balancing system (902) 
are shown, hi one of the embodiments shown in Figure 9, the load balancing system 
(902) includes at least one computer processor (904) coupled (972) for data 
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communications to at least one broker-dealer system (908). In this embodiment, the 
processor is coupled (962-970) through data communications ports (932-940) to a market 
(950). In the illustration of Figure 9, only one market and one group of associated ports 
are shown. In most embodiments, the processor is coupled to more than one market, and 
5 each market is coupled to at least one port, as shown on Figure 8. 

In a further embodiment shown in Figure 9, the processor (904) is programmed to receive 
(920) through a port (936) from a market (950) to which the port is coupled (956) a new 
acknowledgment (916) of an order previously sent through the port (974, 910) from the 

10 broker-dealer system to the market. La this illustrated embodiment, the processor is 
programmed to send (922) the new acknowledgment (916) to the broker-dealer system 
(908). This embodiment includes the processor programmed to determine (930) that the 
port (936) is not overloaded. In the illustrated embodiment, the determination that the 
port is not overloaded is dependent upon the previously-sent order (910), the new 

15 acknowledgment (916), and optionally also dependent upon other previous orders (912) 
and upon previous acknowledgments (918). 

The embodiment illustrated in Figure 9 also includes the processor programmed to send 
(928) a new order (914) through the port (936) to the market (950). The processor's 
20 sending (928) the new order (914) is dependent upon the determination (930) that the port 
is not overloaded. More specifically, in embodiments of the kind illustrated, orders are 
sent to markets over through non-overloaded ports. 

The embodiment illustrated in Figure 9 includes computer memory (906) coupled (976) 
25 to the processor (904). In the illustrated embodiment, the processor (904) is fiirther 
programmed to store (924) in the computer memory (906) the new acknowledgment 
(916) and the new order (914). 

Li a further embodiment shown in Figure 10, the processor (904) programmed to 
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determine that a port is not overloaded (930) further comprises the processor 
programmed to determine (1002) that a latency (1020, 1022) for a port (932) is less than 
a maximum allowed latency (1024) for the port. Latency comprises a measure of the 
speed with which markets return acknowledgments for orders. In one embodiment 
5 shown in Figure 10, the latency for the port is an instant latency (1020). In an alternative 
embodiment, the latency for the port is an average latency (1024). 

In embodiments using latencies as shown in Figure 10, the port latencies are dependent 
upon order data (1010) and acknowledgment data (1014) in that the latencies comprise 
various kinds of comparisons between order times (1012) and acknowledgment times 
(1016). Order times are the times when particular order were sent to a market, and 
acknowledgment times (1016) are the times when acknowledgments corresponding to 
particular orders were received back from markets. 

More specifically, an instant latency (1020) is the difference between the time when a 
recent acknowledgment was received and the time when the acknowledgment's 
corresponding order was sent. In addition, as shown in Figure 5, an average latency in 
some embodiments is a decaying average (524) and in other embodiments is a moving 
average (522). Examples of methods and systems useful with the present invention for 
calculating latencies are set forth in Appendix 1. The use of any method of programming 
a processor to calculate latency is well within the present invention. 

In the embodiment shown in Figure 10, the latency calculations (1018) are performed in a 
broker-dealer system (908) and provided (1026, 1028) to the load balancing system for 
25 storage in computer memory (906). In other embodiments, the processor in the load 

balancing system is programmed to calculate latencies. In the illustrated embodiment of 
Figure 10, the latencies are stored in memory in port data structures (1004-1008) with 
one data structure provided for each port (932-936) used with the system. An example of 
a useM port data structure is shown in Figure 5. Many alternative structures for port data 
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are useful within the scope of the invention. 

A further embodiment of the invention as shown in Figure 11 includes the processor 
(906) programmed to decrement (1 102) a net order count (504) for the port (932). The 
5 net order count (504) indicates the net number of orders sent through the port (932) to the 
market (950) for which acknowledgments have not yet been received j&om the market, hi 
this embodiment, the net order count (504) is decremented (1 102) after (1101) receiving 
(920) a new acknowledgment (916). 

10 The embodiment shown in Figure 1 1 includes the processor (906) programmed to 

determine (1 104) that the net order count (504) is less than a maximum allowed net order 
count (506) for the port (932). The maximum allowed net order count (506) indicates the 
maximum number of orders without acknowledgments allowed to be sent through the 
port (932). The fact that the net order count is less than the maximum allowed net order 

15 coimt for the port indicates that the port is not overloaded. 

This embodiment illustrated in Figure 1 1 includes the processor programmed to 
increment (1 106) the net order count. In some embodiments, the processor is 
programmed to increment (1 106) the net order count after determining (1 104) that the net 
20 order count is less than the maximum net order count but before (1 108) sending a new 
order to market. In other embodiments, the processor is programmed to increment (1 106) 
the net order count after determining (1 104) that the net order count is less than the 
maximum net order count and after (1110) sending a new order to market. 

25 A further embodiment of the invention shown in Figure 12 includes the processor (906) 
progranmied to increment (1202) an acknowledgment count (510) for the port (932). The 
acknowledgment count (510) represents the number of acknowledgments received 
through the port during a defined period of time. An example of a period of time useful 
in the invention is one trading day. Various embodiments of the inventions use other 
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periods of time, shorter or longer. Any functional period of time is well within the scope 
of the invention. 

A further embodiment of the invention shown on Figure 12 includes the processor (906) 
5 programmed to determine (1206) that an order count (508) for the port (932) exceeds the 
acknowledgment count (510) for the port (932) by at least a maximum allowed net order 
count (506). The order count (508) represents the number of orders sent through the port 
(932) during the defined period of time. The maximum net order count (506) indicates 
the maximum number of orders without acknowledgments allowed to be sent through the 
10 port (932). In this embodiment, the fact that the order count (508) for the port exceeds 
the acknowledgment count (510) for the port (932) by at least a maximum allowed net 
order count (506) indicates that the port is not overloaded. 

The embodiment shown in Figure 12 includes also the processor programmed to 
15 increment (1204) the order count (508) for the port (932). In some embodiments, the 
processor is programmed to increment (1204) the order count (508) for the port (932) 
after determining (1206) that the order coxmt (508) for the port (932) exceeds the 
acknowledgment count (510) for the port (932) by at least a maximum allowed net order 
count (506) but before (1208) sending (928) a new order to market. In other 
20 embodiments, the processor is programmed to increment (1204) the order count (508) for 
the port (932) after determining (1206) that an order count (508) for the port (932) 
exceeds the acknowledgment count (510) for the port (932) by at least a maximum 
allowed net order count (506) and after (1210) sending (928) a new order (914) through 
the port (932) to market (950). 

25 

A further embodiment shown on Figure 13 includes the processor (904) programmed to 
determine (1340), before sending (928) the new order through the port (932) to the 
market (950), that the port (932) is a least-loaded port. Li this embodiment, the 
processor's sending (928) the order through the port to the market is dependent upon the 
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determination (1340) that the port is a least-loaded port. More specifically, in this kind of 
embodiment, orders are sent to markets only through least-loaded ports. 

A further embodiment of the invention illustrated in Figure 13 includes a data structure 
5 (1 302) for the port (932) having a net order count (1310) for the port (932). The net 
order count (1310) indicates the net number of orders sent through the port (932) to the 
market (950) for which acknowledgments have not yet been received from the market. In 
the illustrated embodiment, other ports (936, 940) coupled to the market (950) have data 
structures (1304, 1306) having net order counts (1320, 1330). In the illustrated 
10 embodiment, the processor (904) programmed to determine (1340) that the port is a least- 
loaded port further comprises the processor programmed to determine (1342) that the net 
order count (1310) for the port is not greater than any of the net order counts (1320, 
1330) for the other ports coupled to the market (950). 

15 A further embodiment of the invention illustrated in Figure 13 includes a port data 

structure (1302) in which the port data structure has a latency (1312) for the port (932), 
Latency comprises a measure of the speed with which markets return acknowledgments 
for orders. In this embodiment, other ports (936, 940) coupled to the market (950) have 
data structures (1304, 1306) having latencies (1322, 1332). Li the illustrated 

20 embodiment, the processor (904) programmed to determine (1 340) that the port is a least- 
loaded port comprises the processor (904) programmed to determine (1344) that the 
latency (1312) for the port (932) is not greater than any of the latencies (1322, 1332) for 
the other ports (1304, 1306) coupled to the market (950). 

25 A further embodiment of the invention illustrated in Figure 13 includes a port data 

structure (1302) having a net order count (1310) for the port (932) and a latency (1312) 
for the port (932). The net order count (1310) indicates the net number of orders sent 
through the port (932) to the market (950) for which acknowledgments have not yet been 
received from the market. Latency comprises a measure of the speed with which markets 
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return acknowledgments for orders. In the illustrated embodiment, other ports (936, 940) 
coupled to the market (950) also have corresponding data structures (1304, 1306) having 
net order counts (1320, 1330) and latencies (1322, 1332), In the illustrated embodiment, 
the processor (904) programmed to determine (1340) that the port is a least-loaded port 
further comprises the processor programmed (1346) to determine that the product of the 
net order count (1310) for the port (932) multiplied by the latency (1312) for the port 
(932) is not greater than the product of net order count (1320, 1330) and latency (1322, 
1332) for any other port (936, 940) coupled to the market (950). 
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CLAIMS 



What is claimed is: 



1 LA method of balancing data communications loads among data communications ports 

2 in systems for automated trading of securities, the systems including at least one 

3 broker-dealer system coupled through at least one data communications system to 

4 more than one market system, the data communications system including a 

5 multiplicity of ports organized so that one market is coupled to the broker-dealer 

6 system through more than one port, the method operating as an adjunct to a broker- 

7 dealer system, the method applied when a new order from the broker-dealer system is 

8 available and ready to be sent through a port to a market; the method being appUed 

9 continually in turn to each of the ports assigned to a market, the method comprising 

10 the steps of: 
11 

12 receiving through a port from a market to which the port is coupled a new 

13 acknowledgment of an order previously sent through the port from the 

14 broker-dealer system to the market; 

15 sending the new acknowledgment to the broker-dealer system; 

16 determining that the port is not overloaded, the determination being dependent 

17 upon the previously-sent order, the new acknowledgment, and optionally 

1 8 also dependent upon other previous orders and upon previous 

19 acknowledgments; and 

20 sending a new order through the port to the market, the sending of the new order 

21 being dependent upon the determination that the port is not overloaded. 

1 2. The method of claim 1 wherein determining that the port is not overloaded comprises 

2 determining that a latency for the port is less than a maximum allowed latency for the 

3 port, wherein latency comprises a measure of the speed with which markets return 
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4 acknowledgments for orders. 

1 3. The method of claim 1 further comprising decrementing a net order count for the 

2 port, wherein the net order count indicates the net number of orders sent through the 

3 port to the market for which acknowledgments have not yet been received from the 

4 market, wherein the net order count is decremented after receiving a new 

5 acknowledgment. 

1 4, The method of claim 3 fiirther comprising the steps of: 
2 

3 determining that the net order count is less than a maximum allowed net order 

4 count for the port, wherein the maximum allowed net order count indicates the 

5 maximum number of orders without acknowledgments allowed to be sent 

6 through the port, wherein the net order count less than the maximum allowed 

7 net order count for the port indicates that the port is not overloaded; and 
8 

9 incrementing the net order count. 

1 5. The method of claim 1 further comprising incrementing an acknowledgment count 

2 for the port, wherein the acknowledgment count represents the number of 

3 acknowledgments received through the port during a defined period of time. 

1 6. The method of claim 5 farther comprising the steps of: 
2 

3 determining that an order count for the port exceeds the acknowledgment count 

4 for the port by at least a maximum allowed net order count, wherein the order 

5 count represents the number of orders sent through the port during the defined 

6 period of time, wherein the maximum allowed net order count indicates the 

7 maximxmi number of orders without acknowledgments allowed to be sent 
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8 through the port, wherein the order count for the port exceeding the 

9 acknowledgment count for the port by at least a maximum allowed net order 

10 count indicates that the port is not overloaded; and 
11 

12 incrementing the order count for the port. 

1 7. The method of claim 1 further comprising determining, before sending the new order 

2 through the port to the market, that the port is a least-loaded port, wherein sending the 

3 order through the port to the market is dependent upon determining that the port is a 

4 least-loaded port, 

1 8. The method of claim 7 wherein the port comprises a net order count, wherein the net 

2 order count indicates the net number of orders sent through the port to the market for 

3 which acknowledgments have not yet been received from the market, and other ports 

4 coupled to the market have net order counts, wherein determining that the port is a 

5 least-loaded port comprises determining that the net order coimt for the port is not 

6 greater than any of the net order counts for the other ports coupled to the market. 

1 9. The method of claim 7 wherein the port comprises latency, wherein latency 

2 comprises a measure of the speed with which markets return acknowledgments for 

3 orders, wherein the other ports coupled to the market have latencies, wherein 

4 determining that the port is a least-loaded port comprises determining that the latency 

5 for the port is not greater than any of the latencies for the other ports coupled to the 

6 market. 

1 10. The method of claim 7 wherein the port comprises a net order count and a latency, 

2 wherein the net order count indicates the net number of orders sent through the port to 

3 the market for which acknowledgments have not yet been received from the market, 

4 wherein latency comprises a measure of the speed with which markets retxim 
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5 acknowledgments for orders, wherein the other ports coupled to the market have net 

6 order counts and latencies, wherein determining that the port is a least-loaded port 

7 comprises determining that the product of the net order count for the port multiplied 

8 by the latency for the port is not greater than the product of net order count and 

9 latency for any other port coupled to the market. 

1 1 1 . A load balancing system for automated trading of securities in which data 

2 communications loads are balanced among data communications ports, the load 

3 balancing system coupled to a multiphcity of ports organized so that one market is 

4 coupled to the broker-dealer system through more than one port, the load balancing 

5 system operative when a new order from a broker-dealer system is available and 

6 ready to be sent through a port to a market, the load balancing system operative 

7 continually in turn upon each of the ports assigned to a market, the load balancing 

8 system comprising: 

9 

10 at least one computer processor coupled for data communications to at 

1 1 least one broker-dealer system and coupled through data communications 

12 ports to more than one market, the processor programmed to: 

13 receive through a port from a market to which the port is coupled 

14 a new acknowledgment of an order previously sent through 

15 the port from the broker-dealer system to the market; 

16 send the new acknowledgment to the broker-dealer system; 

17 determine that the port is not overloaded, the determination 

1 8 being dependent upon the previously-sent order, the new 

19 acknowledgment, and optionally also dependent upon other 

20 previous orders and upon previous acknowledgments; and 

21 send a new order through the port to the market, the sending of the 

22 new order being dependent upon the determination that the 

23 port is not overloaded; and 
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24 computer memory coupled to the processor, the processor further 

25 programmed to store in the computer memory the new 

26 acknowledgment and the new order. 

1 12. The load balancing system of claim 1 1 wherein the processor programmed to 

2 determine that the port is not overloaded comprises the processor programmed to 

3 determine that a latency for the port is less than a maximum allowed latency for the 

4 port, wherein latency comprises a measure of the speed with which markets return 

5 acknowledgments for orders, 

1 13. The load balancing system of claim 1 1 further comprising the processor programmed 

2 to decrement a net order count for the port, wherein the net order count indicates the 

3 net number of orders sent through the port to the market for which acknowledgments 

4 have not yet been received from the market, wherein the net order count is 

5 decremented after receiving a new acknowledgment. 

1 14. The load balancing system of claim 13 further comprising the processor programmed 

2 to: 

3 

4 determine that the net order count is less than a maximum allowed net order count 

5 for the port, wherein the maximum allowed net order count indicates the 

6 maximum number of orders without acknowledgments allowed to be sent 

7 through the port, wherein the net order count less than the maximum allowed 

8 net order count for the port indicates that the port is not overloaded; and 
9 

10 increment the net order count. 

1 15. The load balancing system of claim 1 1 further comprising the processor programmed 

2 to increment an acknowledgment count for the port, wherein the acknowledgment 
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3 count represents the number of acknowledgments received througji the port during a 

4 defined period of time. 

1 16. The load balancing system of claim 1 5 fiirther comprising the processor programmed 

2 to: 

3 

4 determine that an order count for the port exceeds the acknowledgment count for 

5 the port by at least a maximum allowed net order count, wherein the order 

6 count represents the number of orders sent through the port during the defined 

7 period of time, wherein the maximum allowed net order count indicates the 

8 maximum number of orders without acknowledgments allowed to be sent 

9 through the port, wherein the order count for the port exceeding the 

10 acknowledgment count for the port by at least a maximum allowed net order 

1 1 count indicates that the port is not overloaded; and 
12 

13 increment the order count for the port. 

1 17. The load balancing system of claim 1 1 further comprising the processor programmed 

2 to determine, before sending the new order through the port to the market, that the 

3 port is a least-loaded port, wherein sending the order through the port to the market is 

4 dependent upon the determination that the port is a least-loaded port. 

1 18. The load balancing system of claim 17 wherein a data structure for the port comprises 

2 a net order count for the port, wherein the net order count indicates the net number of 

3 orders sent through the port to the market for which acknowledgments have not yet 

4 been received fi-om the market, and other ports coupled to the market have data 

5 structures having net order counts, wherein the processor programmed to determine 

6 that the port is a least-loaded port comprises the processor programmed to determine 

7 that the net order count for the port is not greater than any of the net order counts for 
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8 



the other ports coupled to the market. 



1 19. The load balancing system of claim 17 wherein a data structure for the port comprises 

2 latency, wherein latency comprises a measure of the speed with which markets return 

3 acknowledgments for orders, wherein the other ports coupled to the market have data 

4 structures having latencies, wherein the processor programmed to determine that the 

5 port is a least-loaded port comprises the processor programmed to determine that the 

6 latency for the port is not greater than any of the latencies for the other ports coupled 

7 to the market. 

1 20. The load balancing system of claim 17 wherein a data structure for the port comprises 

2 a net order count and a latency, wherein the net order count indicates the net number 

3 of orders sent through the port to the market for which acknowledgments have not yet 

4 been received from the market, wherein latency comprises a measure of the speed 

5 with which markets return acknowledgments for orders, wherein the other ports 

6 coupled to the market have data structures having net order counts and latencies, 

7 wherein the processor programmed to determine that the port is a least-loaded port 

8 comprises the processor programmed to determine that the product of the net order 

9 count for the port multiplied by the latency for the port is not greater than the product 

10 of net order count and latency for any other port coupled to the market. 
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ABSTRACT 



Methods and systems for balancing data communications loads among data 
conmixmications ports in systems for automated trading of securities. Embodiments 

5 typically include receiving acknowledgments of orders previously sent through a port 
from a broker-dealer system to a market, sending acknowledgments to the broker-dealer 
system, and determining that port are not overloaded. Various embodiments make 
determinations of overload on the basis of latency, net order count, or order count 
compared with acknowledgment count. Alternative embodiments send orders only 

10 through least-loaded ports. Least-loaded ports are identified on the basis of latency, net 
order count, or a combination of the two. 
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APPENDIX I 



Specification And Figures to: U.S. Patent Application Serial No. 09/574,595 entitled 
"Latency Monitor," inventor Michael Bundy, Attorney Docket Number 3041 8US, filed 
May 19, 2000, 21 pages of Specification and Figure lA through Figure 9, attached hereto 
and incorporated herein by reference. 

BACKGROUND 

Broker-dealers increasingly make available to their customers on-line submission, 
cancellation, and tracking of the status of orders for securities. Securities trading 
customers include day traders, institutions, and active private investors. Such customers 
make many quick decisions regarding when and fi-om whom to order securities. 
Customers are increasingly demanding regarding quality and speed of execution. 
Customers require a high quality of information to support their decision-making. 
Customers are often presented with quotes identifying markets from which particular 
securities can be bought or sold at particular prices. In such quotes there are often several 
markets quoting securities at the current inside price. Markets quoting the same price, 
however, are not the same in terms of quahty of execution. Especially regarding speed, 
all markets are different. It would be usefiil, therefore, if customers had a display of 
information helpfiil in identifying which markets are likely to execute orders more 
quickly than others. 

Modem broker-dealers often subscribe to one or more exchanges or ECNs ("markets") 
capable of executing orders for securities by matching orders with orders of opposite 
side. Orders, cancellations, and responses are communicated to and from markets by use 
of data communications ports. Many broker-dealers handle volumes of orders so large 
as to require more than one port per market. Ports often are not equal in their ability to 
communicate with a particular market. Sometimes ports fail, partially or completely. It 
would be usefiil to have a display of information, for diagnostic purposes within the 
broker-dealer organizations, to help identify problems with particular ports, to help keep 
the overall flow of data communications functioning efficiently. 
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SUMMARY 



One aspect of the invention provides methods for displaying latency. Embodiments of 
the invention are typically implemented in broker-dealer computer systems engaged 
generally in automated processing of orders for securities including sending to markets 
messages comprising orders and cancellations and receiving from markets responses to 
orders and cancellations. Embodiments include recording for messages sent to markets 
the time when each message is sent and the identity of the market to which each message 
is sent. Embodiments include recording for responses received from markets the time 
when each response is received, wherein each response corresponds to a particular 
message. Embodiments include calculating latencies for markets dependent upon 
recorded time when a message is sent to the market and a recorded time when a 
corresponding response is received from the market. Embodiments include latencies for 
ports as well as latencies for markets. Embodiments include displaying the identity of the 
markets and the latencies for the markets. Embodiments include counting and displaying 
the number of messages and responses received and sent during a period of time, for use 
in broker-dealer diagnostics. 

A second aspect of the invention provides automated computing machinery, as system for 
calculating and displaying latency, typically implemented in broker-dealer computer 
systems capable of automated processing of orders for securities, includes sending 
messages to markets and receiving from markets responses to messages. Embodiments 
of this aspect include at least one computer processor programmed to record in computer 
memory, for messages sent to markets, the time when each message is sent and the 
identity of the market to which each message is sent. In such embodiments, processors 
are typically programmed also to record in computer memory, for responses received 
from markets, the time when each response is received. Each response corresponds to a 
particular message. In such embodiments, processors are programmed also to calculate 
for markets latencies dependent upon recorded time when at least one message is sent to 
a market and recorded time when a corresponding response is received from the market. 
In such embodiments, processors typically are programmed also to display the identities 
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of the markets and the latencies for the markets. Embodiments include latencies for ports 
as well as latencies for markets. Embodiments of this aspect typically include computer 
memory coupled to processors, the processors being further programmed to store in 
computer memory the latencies. Embodiments include processors programmed to count 
5 and display the number of messages and responses received and sent during a period of 
time, for use in broker-dealer diagnostics. 

DRAWINGS 

10 Figure 1 A is a general data flow diagram showing various alternative embodiments of the 
invention. 

Figure IB is a detail of relations among ports and markets in various altemative 

embodiments of the invention. 

Figure 2 illustrates calculating instant latency. 
15 Figure 3 illustrates an altemative embodiment using average latency. 

Figure 4 illustrates another ahemative embodiment using average latency. 

Figure 5A illustrates a form of display. 

Figure 5B illustrates an altemative form of display. 

Figure 5C illustrates an altemative form of display. 
20 Figure 6 illustrates computing machinery for various altemative embodiments of the 

invention. 

Figure 7 illustrates computing machinery programmed to calculate instant latency. 
Figure 8 illustrates computing machinery programmed to count and display the number 
of messages and responses received and sent during a period of time. 
25 Figure 9 illustrates computing machinery programmed to count and display the number 
of messages and responses received and sent through a port during a period of time. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 
30 Definitions: 

"Cancellation" is termination of an order, or partial termination of an order, by the 
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customer or by software comprising an embodiment of the invention. In addition, 
markets can cancel orders, or parts of orders, for example, in response to an IOC order. 

"ECN" abbreviates "Electronic Communications Network " referring to an order 
5 matching service that provides Uquidity by matching orders rather than by maintaining 
inventory. In the context of the invention, ECNs are considered markets. ECNs, like 
market makers are identified by use of market participant identification codes or 
"MPIDs." In order to avoid confusion with data communications networks, ECNs are 
referred to as either "ECNs" or as "markets." Some current ECNs, their symbols and 
10 names, are Usted below. The number and identities of ECNs changes fi:-om time to time. 



Examole List of ECNs 


MPID 


Name 


ARCA 


Archipelago 


BTRD 


Bloomberg Trade Book 


INCA 


Instinet 


ISLD 


Island 


MWSE 


Midwest Stock Exchange 


NTRD 


NexTrade 


REDI 


Speer Leeds 



"Exchange" means a national, regional, or international exchange for securities trading 
including for example, Nasdaq or NYSE, 

15 

"Executed," in reference to an order, means that shares have been either bought or sold 
according to the side of the order. 

"Filled" means executed. That is, all shares in the order have been executed, bought or 
20 sold according to the side of the order. If an order is subject to partial fixlfiUment, then 
the order can be partly filled and partly rejected or cancelled, in which case the order will 
never be considered filled. Processing of an order can therefore be completed through 
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some combination of cancellation, rejection, killing, and partial execution without the 
order's ever being filled. Processing of an order is said to be complete when all the 
shares in the order, share by share, have been executed, cancelled, rejected, or killed. 

"Inside price" means, as appropriate, the highest bid price or the lowest ask price for a 
particular security. For buy orders, the inside price is the lowest ask price. For sell 
orders, the inside price is the highest bid price. 

"Latency" means a measure of the speed with which markets respond to orders and 
cancellations. Latency in many embodiments of the invention is determined as the 
difference between the time when a response to an order is received and the time when 
the corresponding order was routed to the market. Latency can be measured from normal 
orders or from test orders. Some markets support test orders as such. For markets in 
which test orders as such are not supported, test orders can be implemented by use of 
unmarketable orders immediately followed by cancellations. For markets receiving 
orders regularly, latency can be tracked from normal orders, without the need for test 
orders. Latency can be embodied as a single ratio difference between two recorded times 
or as various kinds of averages. 

"Level Two Quotes" are quotes that comprise one or more market participant quotes 
("MPQs"). The best known source of level two quotes is Nasdaq, but "level two quotes" 
refers to any form of market information that aggregates market participant quotes for a 
security. 

"Market," "electronic market," "market participant," "electronic market participant," 
"marketing network," and electronic marketing network" are all used as synonyms for 
services accessible through electronic communications networks capable of executing 
orders for securities by accepting from broker-dealers buy orders and sell orders, 
matching or failing to match buy orders with sell orders, and communicating the results 
to the broker-dealers. Generally the term "market" is used to refer to these entities. All 
"markets," as the term is used, are either ECNs or market makers. All available markets 
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have names and symbols as described xmder the definitions of "ECN" and "market 
maker." 

"Market maker" means a broker-dealer providing order matching and liqxiidity in a stock 
by maintaining an inventory of the stock. Market makers typically trade their inventories 
through exchanges. Some currently active market makers, their symbols and names, are 
hsted below. The number and identity of market makers can change Jfrom time to time. 



Example List of Market Makers 


MPID 


Name 


BEST 1 


Bear, Steams & Co., Inc. 


BTAB 


Mox, Brown & Sons, Inc. 


GSCO 


Goldman, Sachs & Co. 


HMQT 


Hambrecht & Quist, LLC 


HRZG 


Herzog, Heine, Geduld, Inc. 


JANY 


Janney Montgomery Scott, Inc. 


LEHM 


Lehman Brothers, Inc. 


MADF 


Bemard L. Madoff 


MLCO 


Merrill Lynch, Pierce, Fenner & 
Smith Inc. 


MOKE 


Morgan, Keehan & Co., Inc. 


MONT 


Nationsbanc Montgomery Securities, 
LLC 


MSCO 


Morgan Stanley & Co., Inc. 


NITE 


Knight Securities, L.P. 


OLDE 


Olde Discount Corporation 


OPCO 


CIBC Oppenheimer Corporation 


PIPR 


Piper Jaffray Inc. 


PRUS 


Prudential Securities, Inc. 


PWJC 


Paine Webber, Inc. 
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RAJA 


Raymond James & Associates, Inc. 


SBSH 


Smith Barney, Inc. 


SHRP 


Sharpe Capital, Inc. 


SHWD 


Sherwood Securities Corporation 



"Orders" are orders for purchase or sale of securities. In many of the embodiments 
described, "orders" are electronic orders for purchase or sale of securities. 

5 "Quotes" are aggregates of information regarding securities traded in markets. Quotes 
include for securities Hsted for sale or purchase, symbols identifying the securities, price, 
side, quantities, and market identifications or MPIDs. Quotes can come from exchanges 
or directly from markets. A "Nasdaq Level Two Quote" includes market information in 
the form of market participant quotes for all markets offering to buy or sell a particular 

1 0 security through Nasdaq. 

"Securities" are any agreement for investment. Stocks are the securities most often 
addressed in described embodiments of the invention. The invention, however, is 
appUcable to many kinds of securities including, for example, options, commodities, and 
15 bonds. 

"Side" refers to which side of the market is represented by an order or a quote. Side 
indicates whether the quote or order is to buy or sell, bid or ask. "Bid" indicates the buy 
side. "Ask" indicates the sell side. The present invention functions equally for either 
20 side of a transaction. Therefore we attempt to speak in neutral terras regarding side. We 
speak of execution rather than buying or selling. We use the term "price improvement" 
to indicate both price reductions for buy orders and price increases for sell orders. 

Detailed Description: 

25 

Turning now to Figure lA, a first aspect of the invention is seen. One embodiment 
illustrated in Figure 1 A provides a method of displaying latency. The embodiment is 
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implemented in a broker-dealer computer system. The system is engaged in automated 
processing of orders (150) for securities including sending (104) messages (102) to 
markets (108) and receiving (112) from markets (108) responses (114) to messages. 

5 The illustrated embodiment includes recording (106) for messages sent to markets the 
time (120) when each message is sent and the identity (118) of the market to which each 
message is sent, the messages (102) comprising orders (150) and cancellations (148) of 
orders. This first embodiment includes also recording (1 10) for responses received from 
markets the time (122) when each response is received, wherein each response 

1 0 corresponds to a particular message. 

This embodiment mcludes also calculating (124) for at least one market a latency (128) 
dependent upon at least one recorded time (120) when at least one message is sent to the 
market and at least one recorded time (122) when a corresponding response is received 
15 from the market. The illustrated embodiment includes displaying (130) the identity (1 18) 
of the market and the latency (128) for the market, hi a fiulher embodiment shown in 
Figure 1 A, latency (128) is a latency for a port (154), the port being identified by Port ID 
code (156). 

20 Shown in Figure 5A is an example of a form of display useftil with many embodiments of 
the invention. The example in Figure 5 A illustrates a columnar display of identities (118) 
of markets and latency implemented as an instant latency (502) for each market and an 
average latency (504) for each market. 

25 As shown on Figure 1 A, the display function (130) in many embodiments sends (133) the 
display (135) to display devices (134) by use of data communications (132). Data 
communications (132) in some embodiments includes networks, such as intranets, 
extranets, or internets, and in other embodiments includes satellite channels, direct 
telephone links, and other forms of data communications. Use of any form of data 
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communications is well within the invention. 



In a further embodiment, shown in Figure 2, latency is implemented as an instant latency 
(202). The instant latency (202) is calculated (204) dependent upon one recorded time 
5 (120) when one message is sent to a market and one recorded time (122) when a 
corresponding response is received from the market. 

In a still further embodiment, shown in Figure 3, latency is implemented as an average 
latency (320). The average latency (320) is dependent upon at least one recorded time 
10 (306, 314) when at least one message is sent to the market and at least one recorded time 
(308, 316) when a corresponding response is received from the market, hi embodiments 
of the kind shown in Figure 3, the recorded times (306, 308, 314, 316) used in calculating 
the average latency (320) are recorded during a defined period of time (322). 

15 In a further embodiment, shown in Figure 4, the latency is implemented as an average 
latency (420). The average latency is dependent upon at least one recorded time (408, 
414) when at least one message is sent to the market and at least one recorded tune (410, 
416) when a corresponding response is received from the market. In embodiments shown 
in Figure 4, the number of recorded times (408, 410, 414, 416) used to calculate the 

20 average latency (420) is limited to a defined maximum number "N" (422). In many 
embodiments of this kind, the N recorded times used to calculate average latency are the 
N most recent recorded times. 

A further embodiment shown in Figure lA includes the steps of countuig (136) the 
25 number of messages sent to at least one market during a period of time, including storing 
in computer memory (140) the number of messages (144) sent to the market during the 
period of time. In many embodiments of this kind, the counting steps (138, 136) 
determine time periods m dependence upon a computer system clock (170). 

30 The illustrated embodiment includes also counting (138) the number of responses 
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received from the market during the period of time, including storing in computer 
memory (140) the number of responses (146) received from the market during the period 
of time. The embodiment includes also displaying (130), in addition to the identity (118) 
of the market and the latency (128) for the market, the number of messages (144) sent to 
5 the market and the number of responses (146) received from the market during the period 
of time. 

Figure 5C shows an example of a display usefiil with various embodiments using such 
displays display in columnar form the market identities (118), latencies (320), number of 

10 messages sent during a period of time (144), and the number of responses received during 
a period of time (146). As shown on Figure lA, the display fimction (130) in many 
embodiments sends (133) the display (135) to display devices (134) by use of data 
communications (132). Data communications (132) in some embodiments includes 
networks, such as intranets, extranets, or internets, and in other embodiments includes 

15 satellite channels, direct telephone links, and other forms of data communications. Use 
of any form of data communications is well within the invention. 

An example of the use of message counts for diagnostic purposes is a display showing an 
increase in latency for a port explained by an increase in message counts for the port, thus 
20 indicating the port slowed down because its work load increased, and indicating also that 
there is no problem with the system. Another example is a display showing an increase 
in latency for a port explained by the port's message count going to zero, thus indicating 
that the increase in latency is caused by a catastrophic failure of the port. 

25 In a further embodiment, shown in Figure 1 A, the system includes the steps of counting 
(136) the number of messages sent to a market through a port (154) during a period of 
time, including storing in computer memory (140) the number of messages (144) sent to 
the market through the port during the period of time. In many embodiments of this kind, 
the counting steps (138, 136) determine time periods in dependence upon a computer 

30 system clock (1 70). 
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The illustrated embodiment includes also counting (138) the number of responses 
received from the market through the port during the period of time, including storing in 
computer memory (140) the number of responses (146) received from the market through 
the port during the period of time. The system includes also displaying (130), in addition 
5 to the identity (118) of the market and the latency (128) for the market, the number of 
messages (144) sent to the market through the port and the number of responses (146) 
received from the market through the port during the period of time. 

Figure 5B shows an example of a display usefril with various embodiments of the 
10 invention. Embodiments using such displays display in columnar form the market 
identities (118), port identity codes (154), instant latencies (202), average latencies (320), 
number of messages sent during a period of time (144), and the number of responses 
received during a period of time (146). 

15 As shown on Figure 1 A, the display fimction (130) in many embodiments sends (133) the 
display (135) to display devices (134) by use of data communications (132). Data 
communications (132) in some embodiments includes networks, such as intranets, 
extranets, or internets, and in other embodiments includes satellite channels, direct 
telephone links, and other forms of data communications. Use of any form of data 

20 communications is well within the invention. 

Turning now to Figure 6, an additional aspect of the invention is seen. One embodiment 
shown in Figure 6 is automated computing machinery implementing a broker-dealer 
computer system (602). The illustrated embodiment is capable of automated processing 
25 of orders for securities, including sending (606) messages (604) to markets (608) and 
receiving (610) from markets (608) responses (612) to messages. 

The illustrated embodiment includes at least one computer processor (618) programmed 
to record (622) in computer memory (620), for messages sent to markets, the time (632) 
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when each message is sent and the identity (630) of the market (608) to which each 
message is sent, the messages including orders (614) and cancellations (616) of orders. 
In this embodiment, the processor is programmed also to record (624), in computer 
memory (620), for responses (612) received (610) from markets, the time (634) when 
5 each response is received. Each response (612) corresponds (642) to a particular message 
(604). 

In this example embodiment, the processor is programmed also to calculate (626), for at 
least one market (608) a latency (628) dependent upon at least one recorded time (632) 

10 when at least one message is sent to the market and at least one recorded time (634) when 
a corresponding response is received from the market. In this embodiment, the processor 
is programmed also to display (632) of the identity (630) of the market and the latency 
(628) for the market. In a further embodiment shown in Figure 6, latency (628) for a 
market (608) is also latency for a port (644), the port being identified in data by a port ID 

15 code (646). 

As shown on Figure 6, the display function (632) in many embodiments sends (633) the 
display (635) to display devices (638) by use of data communications (636). Data 
communications (636) in some embodiments includes networks, such as intranets, 
20 extranets, or intemets, and in other embodiments includes satellite chaimels, direct 
telephone links, and other forms of data commimications. Use of any form of data 
communications is well within the invention. The embodiment illustrated in Figure 6 
includes also computer memory (620) coupled (640) to the processor (618), the processor 
being fiarther programmed to store (630) in computer memory (620) the latency (628). 

25 

In a further embodiment shown in Figure 7, latency comprises an instant latency. In the 
embodiment of Figure 7, the processor (618) is programmed to calculate (626) latency as 
an instant latency (702) calculated dependent upon one recorded time (632) when one 
message is sent to a market and one recorded time (634) when a corresponding response 
30 is received from the market. 
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In some embodiments^ the processor is programmed to calculate latency as an average 
latency dependent upon at least one recorded time when at least one message is sent to 
the market and at least one recorded time when a corresponding response is received 
from the market. In such embodiments, as illustrated in Figure 3, recorded times (306, 
5 308, 314, 316) used in calculating the average latency (320) are recorded during a deJSned 
period of time (322). 

In other embodiments, the processor is programmed to calculate latency as an average 
latency dependent upon at least one recorded time when at least one message is sent to 
10 the market and at least one recorded time when a corresponding response is received 
from the market. In such embodiments, as shown in Figure 4, the number of the recorded 
times (408, 410, 414, 416) used to calculated the average latency is limited to a defined 
maximum number "N" (422). In many embodiments of this kind, the N recorded times 
used to calculate average latency are the N most recent recorded times. 

15 

In a fiirther embodiment shown in Figure 8, latency comprises an average latency. In 
embodiments of the kind shown in Figure 8, the processor (618) is further progrannned to 
count (802) the number (806) of messages (604) sent (606) to at least one market (608) 
during a period of time, including storing in computer memory (620) the number of 
20 messages (806) sent to the market during the period of time. Periods of time in many 
embodiments are determined dependent upon a system clock (816). 

The processor in many embodiments of the kind illustrated in Figure 8, is also 
programmed to count (804) the number (808) of responses (612) received (610) from the 
25 market (608) during the period of time, including storing in computer memory (620) the 
number of responses (808) received from the market during the period of time. The 
system includes also displaying (814), in addition to the identity of the market and the 
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latency for the market, the number of messages (806) sent to the market and the number 
of responses (808) received from the market during the period of time. 

Figure 5C shows an example of a display useful with various embodiments of the 
5 invention. Embodiments using such displays display in columnar form the market 
identities (118), latencies (320), number of messages sent during a period of time (144), 
and the number of responses received during a period of time (146). As shown on Figure 
8, the display function (814) in many embodiments sends (815) the display (817) to 
display devices (638) by use of data communications (636). Data communications (636) 
10 in some embodiments includes networks, such as intranets, extranets, or intemets, and in 
other embodiments includes satelHte channels, direct telephone links, and other forms of 
data communications. Use of any form of data communications is well within the 
invention. 

15 Li a further embodiment shown in Figure 9, the processor (618) is programmed to count 
(904) the number of messages (604) sent to a market (608) through a port (902) during a 
period of time, including storing (914) in computer memory (620) the number of 
messages (912) sent to the market (608) through the port (902) during the period of time. 
Periods of time in such embodiments typically are determined dependent upon a system 

20 clock (816). 

The processor in many embodiments of the kind illustrated in Figure 9 is also 
programmed to count (906) the number of responses (612) received (610) from the 
market (608) through the port (902) during the period of time, including storing (916) in 
25 computer memory (620) the number of responses (910) received from the market (608) 
through the port (902) during the period of time. The embodiment as illustrated includes 
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also displaying (908), in addition to the identity (630 on Figure 6) of the market and the 
latency (628 on Figure 6) of the market, the number of messages (912) sent to the market 
(608) through the port (902) and the number of responses (910) received from the market 
(608) through the port (902) during the period of time. 

5 

Figure 5B shows an example of a display useful with various embodiments of the 
invention. Embodiments using such displays display in columnar form the market 
identities (1 18), port identity codes (154), instant latencies (202), average latencies (320), 
number of messages sent during a period of time (144), and the number of responses 

10 received during a period of time (146). As shown on Figure 9, the display function (908) 
in many embodiments sends (909) the display (911) to display devices (638) by use of 
data communications (636), Data commxmications (636) in some embodiments includes 
networks, such as intranets, extranets, or internets, and in other embodiments includes 
satellite channels, direct telephone links, and other forms of data communications. Use 

1 5 of any form of data conmiunications is well within the invention. 
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CLAIMS 



What is claimed is: 

1 1. A method of displaying latency, the method implemented in a broker-dealer 

2 computer system, the system being engaged in automated processing of orders for 

3 securities including sending messages to markets and receiving from markets responses 

4 to messages, the method comprising the steps of: 

5 recording for messages sent to markets the time when each message is sent and the 

6 identity of the market to which each message is sent, the messages comprising orders 

7 and cancellations of orders; 

8 recording for responses received from markets the time when each response is received, 

9 wherein each response corresponds to a particular message; 

10 calculating for at least one market a latency dependent upon at least one recorded time 

11 when at least one message is sent to the market and at least one recorded time when a 

12 corresponding response is received from the market; 

13 displaying the identity of the market and the latency for the market. 

1 2. The method of claim 1 wherein the latency for a market ftather comprises latency for 

2 a port. 

1 3. The method of claim 1 wherein the latency comprises an instant latency calculated 

2 dependent upon one recorded time when one message is sent to a market and one 

3 recorded time when a corresponding response is received from the market. 

1 4. The method of claim 1 wherein the latency comprises an average latency dependent 

2 upon at least one recorded time when at least one message is sent to the market and at 

3 least one recorded time when a corresponding response is received from the market, 

4 wherein all the recorded times used in calculating the latency are recorded during a 

5 defined period of time. 



Page 16 of 21 



1 5. The method of claim 1 wherein the latency comprises an average latency dependent 

2 upon at least one recorded time when at least one message is sent to the market and at 

3 least one recorded time when a corresponding response is received from the market, 

4 wherein the niunber of recorded times used to calculated the average latency is limited to 

5 a defined maximum. 



1 6. The method of claim 1 wherein the latency comprises an average latency dependent 

2 upon at least one recorded time when at least one message is sent to the market and at 

3 least one recorded time when a corresponding response is received from the market, 

4 wherein the calculating uses the latest recorded time when a message is sent to the market 

5 and the latest recorded time when a corresponding response is received from the market, 

6 and wherein the number of recorded times used to calculated the average latency is 

7 limited to a defined maximum. 

1 7. The method of claim 1 further comprising the steps of: 

2 counting the number of messages sent to at least one market during a period of time, 

3 including storing in computer memory the number of messages sent to the market during 

4 the period of time; 



5 counting the number of responses received from the market during the period of 

6 time, including storing in computer memory the number of responses 

7 received from the market during the period of time; and 

8 displaying, in addition to the identity of the market and the latency for the market, 

9 the number of messages sent to the market and the number of responses 
10 received from the market during the period of time. 



1 8. The method of claim 1 further comprising the steps of: 

2 counting the number of messages sent to a market through a port during a period 

3 of time, including storing in computer memory the number of messages 

4 sent to the market through the port during the period of time; 

5 counting the number of responses received from the market through the port 
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6 during the period of time, including storing in computer memory the 

1 number of responses received from the market through the port during the period 

2 of time; and 

3 displaying, in addition to the identity of the market and the latency for the market, 

4 the number of messages sent to the market through the port and the 

5 number of responses received from the market through the port during the 

6 period of time. 

1 9. Automated computing machinery comprising a broker-dealer computer system, the 

2 system being engaged in automated processing of orders for securities including sending 

3 messages to markets and receiving from markets responses to messages, the machinery 

4 comprising: 

5 at least one computer processor programmed to: 

6 record in computer memory, for messages sent to markets, the time when 

7 each message is sent and the identity of the market to which each 

8 message is sent, the messages comprising orders and cancellations 

9 of orders; 

10 record in computer memory, for responses received from markets, the time 

11 when each response is received, wherein each response 

12 corresponds to a particular message; 

13 calculate, for at least one market, a latency dependent upon at least one 

14 recorded time when at least one message is sent to the market and 

15 at least one recorded time when a corresponding response is 

1 6 received from the market; 

17 display the identity of the market and the latency for the market; and 

18 computer memory coupled to the processor, the processor being fiirther 

19 programmed to store in computer memory the latency. 

1 10. The automated computing machinery of claim 9 wherein the latency for a market 
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2 further comprises latency for a port. 

1 11. The automated computing machinery of claim 9 wherein the processor is ftirther 

2 programmed to calculate latency as an instant latency calculated dependent upon one 

1 recorded time when one message is sent to a market and one recorded time when a 

2 corresponding response is received from the market. 

1 12. The automated computing machinery of claim 9 wherein the processor is further 

2 programmed to calculate latency as an average latency dependent upon at least one 

3 recorded time when at least one message is sent to the market and at least one recorded 

4 time when a corresponding response is received from the market, wherein all the 

5 recorded times used in calculating the latency are recorded during a defined period of 

6 time. 

1 13. The automated computing machinery of claim 9 wherein the processor is further 

2 programmed to calculate latency as an average latency dependent upon at least one 

3 recorded time when at least one message is sent to the market and at least one recorded 

4 time when a corresponding response is received from the market, wherein the number of 

5 recorded times used to calculated the average latency is limited to a defined maximum. 

1 14, The automated computing machinery of claim 9 wherein the latency comprises an 

2 average latency dependent upon at least one recorded time when at least one message is 

3 sent to the market and at least one recorded time when a corresponding response is 

4 received from the market, wherein the processor is further programmed to calculate 

5 latency dependent upon the latest recorded time when a message is sent to the market and 

6 the latest recorded time when a corresponding response is received from the market, and 

7 wherein the processor is further programmed to use in calculating average latency a 

8 number of recorded times limited to a defined maximum. 

1 15. The automated computing machinery of claim 9 fiirther comprising the processor 
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2 further programmed to : 



1 count the number of messages sent to at least one market during a period of time, 

2 including storing in computer memory the number of messages sent to the 

3 market during the period of time; 

4 count the number of responses received from the market during the period of 

5 time, including storing in computer memory the number of responses 

6 received from the market during the period of time; and 

7 display, in addition to the identity of the market and the latency for the market, 

8 the number of messages sent to the market and the number of responses 

9 received from the market during the period of time. 
10 

11 16. The automated computing machinery of claim 9 ftirther comprising the processor 

12 ftirther programmed to: 

13 count the number of messages sent to a market through a port during a period of 

14 time, including storing in computer memory the number of messages sent 

15 to the market through the port during the period of time; 

16 count the number of responses received from the market through the port during 

17 the period of time, including storing in computer memory the number of 

18 responses received from the market through the port during the period of time; 

19 and 

20 display, in addition to the identity of the market and the latency for the market, 

21 the number of messages sent to the market through the port and the 

22 number of responses received from the market through the port during the 

23 period of time. 
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ABSTRACT 



Method and system for displaying latency, useful in broker-dealer computer systems 
engaged generally in automated processing of orders for securities including sending to 

5 markets messages comprising orders and cancellations and receiving from markets 
responses to orders and cancellations, including recording for messages sent to markets 
the time when each message is sent and the identity of the market to which each message 
is sent, including recording for responses received from markets the time when each 
response is received, wherein each response corresponds to a particular message. 

10 Embodiments include calculating latencies for markets dependent upon recorded time 
when a message is sent to the market and a recorded time when a corresponding response 
is received from the market. Latencies are embodied alternatively as instant values or 
various kinds of averages. Embodiments includes latencies for communications ports as 
well as for markets. Embodiments include counting messages and responses for markets 

15 and for ports, and displaying the counts. Embodiments include displaying the identity of 
the markets and the latencies for the markets. 
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(Application Serial No.) (Filing Date) (Status: pending, patented, abandoned) 

(AppHcation Serial No.) (Filing Date) (Status, pending, patented, abandoned) 

I hereby appoint the following attomey(s) and/or agent(s): Gordon T. Arnold (Reg. No. 32,395), John R. 
Riggers (Reg. No. 44,537), Kenneth R Beyers (Reg. No. 36,409), Jeffrey S. Schubert (Reg. No, 43,098), and H. 
Artoush Ohanian (Reg. No. 46-022), all of the firm Arnold & Associates, 2603 Augusta, Suite 800, Houston, Texas 
77057, telephone number (713) 972-1150, to prosecute this application and to transact all business in the Patent and 
Trademark Office connected therewith. 
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I hereby declare that all statements made herein of my own knowledge are true and that all statements 
made on information and belief are believed to be true; and further that these statements were made with the 
knowledge that willful false statements and the like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such willful false statements may jeopardize the validity 
of the application or any patents issued thereon. 



Full Name of First or Joint Inventor: LfanAmanat 

Inventor's Signature: jt^S^^!!!^^^^ Date: t/VffX^&<^ 

Residence: 200 E. 94^ Street^Apt. 1712. New York. NY 10128 . 

Citizenship: United States of America _^ . 

Post Office Address: 



Full Name of Second or Joint Inventor: Michael Bundy 



Inventor's Signature: 

Residence: 22422 Cove Hollow. Katv. TX 77450 

Citizenship: United States of America 

Post Office Address: Same 
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I hereby declare that all statements made herein of my own knowledge axe true and that all statements 
made on infomiation and belief are believed to be true; and further that these statements were made with the 
knowledge that willful false statements and the hke so made are punishable by fine or inprisonment, or both, under 
Section 1001 of Title 18 of flie United States Code and that such willful false statements may jeopardize the vahdity 
of the appHcation or any patents issued thereon. 

Full Name of First or Joint Inventor: Lfan Amanat 

Inventor's Signature: Date:, _ 

Residence: 200 E. 94^ Street. Ant. 1712. New YorL NY 10128 . 

Citizenship: United States of America — 



Post Office Address: 



Full Name of Second or Joint Inventor: 




Inventor's Signature: ^^^^^^^ Jy] 

Residence: 22422 Cove Hoflo^Katv, TX 77450 
Citizenship: United States of America 



Post Ofi&ce Address: Same 
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